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Abstract —The use of active narrow-band interference (NBI) 
suppression in direct-sequence spread-spectrum (DS-SS) com¬ 
munications has been extensively studied. In this paper, we 
address the problem of optimum coding-spreading tradeoff 
for NBI suppression. With maximum likelihood decoding, we 
first derive upper bounds on the error probability of coded 
systems in the presence of a special class of NBI, namely, 
multi-tone interference with orthogonal signatnres. By employ¬ 
ing the well-developed bounding techniques, we show there is 
no advantage in spreading, and hence a low-rate full coding 
approach is always preferred. Then, we propose a practical 
low-rate turbo-Hadamard coding approach, in which the NBI 
suppression is naturally achieved through iterative decoding. The 
proposed turbo-Hadamard coding approach employs a kind of 
coded spread-spectrum signalliug with time-varying spreading 
sequences, which is sharply compared with the code-aided DS-SS 
approach. With a spreading sequence of length 32 and a fixed 
bandwidth allocated for both approaches, it is shown through 
extensive simulations that the proposed tnrbo-Hadamard coding 
approach outperforms the code-aided DS-SS approach for three 
types of NBI, even when its transmission information rate is 
about 5 times higher than that of the code-aided DS-SS approach. 
The nse of the proposed turbo-Hadmard coding approach in 
multipath fading channels is also discussed. 

Index Terms —Narrow-band interference, coding, spreading, 
turbo-Hadamard codes, spread-spectrum signalliug. 


I. Introduction 

PREAD-SPECTRUM signalling has found wide applica¬ 
tions in both civilian and military communications. Al¬ 
though spread-spectrum communication is inherently resistant 
to narrow-band interference (NBI), which may be caused in 
a hostile environment or by coexistence with low-rate com¬ 
munications, substantial performance gains can be achieved 
through the use of active NBI suppression prior to despreading 
and demodulating m, El. The NBI signal is often modeled 
either as a sinusoidal signal (tone) or an autoregressive (AR) 
signal. The NBI signal can also be a digital signal, such as 
would arise, for example, in a multirate signalling system El. 

In the past, a significant amount of research has been 
concerned with the development of techniques for active NBI 
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suppression in spread-spectrum systems. In general, there are 
two categories for these techniques, one is based on linear 
signal processing techniques El and the other employs model- 
based techniques jT), including nonlinear filtering techniques 
and multiuser detection techniques. In ||2l, H, a code-aided 
approach was proposed by Poor and Wang for NBI suppression 
in direct-sequence code-division multiple-access (DS/CDMA) 
networks. This method, which is based on the minimum mean 
square error (MMSE) linear detector, has been shown to out¬ 
perform all of the previous linear or nonlinear methods for NBI 
suppression. In recent years, NBI suppression has also been 
considered in ultra-wide bandwidth (UWB) communications 
El-lSl. New signal processing algorithms for NBI suppression 
have also been reported in Co), im. 

The code-aided direct-sequence spread-spectrum (DS-SS) 
approach El can be combined with channel coding to further 
improve the system performance. However, this traditional use 
of channel coding may not exploit its full potential for NBI 
suppression. For a spread-spectrum multiple-access channel, it 
was pointed out early by Viterbi ca that the ultimate capacity 
can be achieved when the entire spreading is dedicated to error 
control. Optimum coding-spreading tradeoff for a multiple- 
access channel was also addressed in Ha. It was implied in 
ifOll that coding and spreading should be combined using low- 
rate codes with the maximized coding gain. Such a strategy 
has been considered in m, na. However, it remains open 
for the problem of optimum coding-spreading tradeoff when 
the NBI suppression is concerned. 

The low-rate turbo-Hadamard codes, originally proposed 
in M, have been shown to perform very close to the 
ultimate Shannon limit for the additive white Gaussian noise 
(AWGN) channel. With a very simple trellis representation 
of component convolutional Hadamard codes, an iterative 
decoder was proposed in na, which can be efficiently im¬ 
plemented with negligible trellis complexity but leaving the 
complexity with the a posteriori probability (APR) decoding 
of the Hadamard code. It was also shown lHa that the APP 
decoding of Hadamard codes can be accomplished by a very 
efficient APP Fast-Hadamard-Transform (FHT). In ifTSll . a low- 
rate turbo-Hadamard coding scheme was proposed to replace 
the traditional coding-spreading structure of DS-SS systems, 
which leads to significant performance improvement for the 
synchronous multiple-access channel. 

This paper focuses on the problem of coding versus spread¬ 
ing for the purpose of NBI suppression, a problem of great 
concern in military communications. For military communica¬ 
tions, the signal must be designed so that it cannot be received 
and decoded by enemy forces, or it has low probability of 
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interception (LPI). This is often achieved by spreading the 
signal so that its bandwidth is much larger than the true 
date rate. Hence, a low-rate coding structure for military 
communications is desired due to the requirement of LPI. For 
hostile jamming from potential enemy forces, the jammer often 
monitors the transmitted signal and concentrates its power 
in a few frequencies within the dominant transmitted signal 
bandwidth. Hence, the jamming signal is often regarded as 
NBI. 

For spread-spectrum signalling aiming at NBI suppression, 
we conjecture that the entire spreading should be again ded¬ 
icated to error control coding. In this paper, we first pro¬ 
vide a partial theoretical justification of this conjecture under 
maximum-likelihood decoding. Then, we propose a practical 
low-rate turbo-Hadamard coding approach with consequently 
large bandwidth expansion for NBI suppression. We point out 
that this conjecture has also been independently observed in 
[?] for partial-band jamming in frequency-hopping systems. 

For the purpose of NBI suppression, we observe that if a full 
turbo-Hadamard codeword (without puncturing information 
bits for each component convolutional-Hadamard code) is 
transmitted over the channel, the resulting signal presents the 
form of DS-SS signalling, but with time-varying Hadamard 
sequences. Therefore, it can be well understood that the code- 
aided approach for NBI suppression might be still useful. Due 
to a low-rate coding structure, the NBI suppression can be 
naturally achieved through iterative decoding. 

In El, El, it was observed that a proper use of interleav¬ 
ing in direct-sequence spreading can be beneficial for multi¬ 
user interference (MUI) cancellation, where the spreading se¬ 
quence is time-varying due to the introduction of interleaving. 
The proposed turbo-Hadamard coding approach employs a 
kind of DS-SS signalling with time-varying spreading se¬ 
quences. Compared to El, El, the observed time-varying 
spreading sequences in the turbo-Hadamard coding approach 
are controlled by the coding rule, and hence an extra coding 
gain can be achieved. 

The main contributions of this paper are summarized as 
follows: 

1) By assuming a special type of NBI, namely, the multi- 
tone interference with orthogonal signatures, we derive 
upper bounds on the error probability of coded systems 
in the presence of both AWGN and NBI. Then, we 
provide a partial justification of the conjecture that the 
optimum coding-spreading tradeoff always favors full 
coding for NBI suppression. 

2) A practical low-rate full coding approach for NBI sup¬ 
pression is proposed, which has never been reported for 
the purpose of NBI suppression. 

3) With a matched hlter receiver at chip rate, the proposed 
turbo-Hadamard coding approach shows significantly 
higher spectral efficiency compared to the traditional 
DS-SS approach. 

4) Considering that in the presence of NBI, the extrinsic 
information for iterative decoding cannot be directly 
extracted at the positions of systematic (information) 
bits, an approximate method is proposed and simulations 
show that this approximate method works well. 


5) It is shown that the APP decoding of Hadamard codes 
in the presence of NBI can be implemented using FHT, 
which facilitate its practical implementation. 

6) The full coding approach for NBI suppression can also 
be applied to multipath fading channels. We consider 
quasi-static fading channels and show that it is possible 
to develop a low-complexity iterative receiver for mul¬ 
tipath channels with long Hadamard sequences. 

The rest of the paper is organized as follows. The optimum 
coding-spreading tradeoff for NBI suppression is investigated 
in Section II. In Section-Ill, we give a brief description of 
low-rate full turbo-Hadamard codes without puncturing. This 
coding approach is employed for NBI suppression through 
iterative decoding as shown in Section-IV. Section-V presents 
simulation results and Section-VI concludes the paper. 

H. Coding vs. Spreading 
A. System Model 

Consider a baseband signal model with only one user at the 
receiver 

r{t) = ^/p'sc{t)+ i{t)+w{t), (1) 

where c{t) is the spread-spectrum signal of the user and Pg 
is the received signal power, i{t) and w{t) represent the NBI 
signal and the ambient channel noise, respectively. 

We consider two approaches for NBI suppression, namely, 
a code-aided DS-SS approach and a full coding approach, as 
shown in Fig. [T] For both approaches, it is assumed that a 
block channel coding scheme is employed. At the transmitter, 
information bits are grouped into data frames and then input to 
the block encoder. For a full coding approach, the coding rate 
should be low enough for expanding the signal spectrum. For 
a coded DS-SS approach, the (channel) coding rate is often 
larger than ^ and the signal spectrum is mainly expanded by 
direct-sequence spreading. 

It should be mentioned that the conventional coded DS- 
SS approach can also be viewed as a general coding ap¬ 
proach, where the traditional channel coding is serially con¬ 
catenated with repetition coding (direct-sequence spreading) 
as described in Fig. [T] Hence, both approaches can be viewed 
as a unified coding approach. 

Denote by Tp and Ti, the frame duration and the infor¬ 
mation bit duration, respectively. Suppose now that every 
K information bits are grouped as a date frame, namely, 
Tp = KTi. With a unified coding view for both approaches 
shown in Fig.[T] we can consider that information bits are input 
to a low-rate encoder, which outputs coded bits (in chips) with 
duration Tc (chip duration). In this paper, we always assume 
that Ti » Tc- 

Assuming that a block channel coding scheme is inde¬ 
pendently implemented over each frame, we can arrive at a 
signal vector representation, by projection of the signals onto 
a hnite basis. Indeed, the received signal (column) vector r of 
length L = Tp/Tc during a frame can be obtained by passing 
€ [0,Tp) through a chip-matched hlter, followed by a 
chip-rate sampler, giving 

r = a/^c -f i -f w, 


( 2 ) 
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NBI AWGN Chip Rate 



a) Code-aided DS-SS approach for NBI suppression 


NBI AWGN Chip Rate 



b) Full coding approach for NBI suppresion 


Fig. 1. The block diagrams of two NBI suppression approaches. 


where c is a binary-phase-shift-keying (BPSK) modulated 
codeword, w is a sample vector of zero-mean Gaussian noise 
with variance cr^ and i denotes a collected column vector form 
of the NBI. 

For the traditional coded DS-SS approach, this model still 
holds. However, the NBI suppression is often achieved via lin¬ 
ear MMSE approach with one-shot symbol duration Tg, where 
n = Ts/Tc is often employed to denote the spreading factor. 
Hence, the received signal vector should be further partitioned 
as sub-vectors of length n, i.e., r = [rf, r^, • • • , r^, • • • , 
with B = Tp/Ts- Then, the fcth received sub-vector during 
one symbol period Tg can be represented as 

rfc = \/^Cfc + ifc + Wfc, (3) 

where is the data-bearing (±1 modulated) spreading- 
sequence vector, Wfe is a Gaussian noise vector and denotes 
a NBI vector, which is assumed to be wide-sense stationary 
with mean zero and covariance matrix Ri. 

With a linear MMSE approach for NBI suppression, the 
detector simply makes a symbol-by-symbol decision as bk = 
sgn where u is chosen to minimize the mean-square 

error 


MSE = E {u'^rfc - sgn (u^rfe)} . (4) 


B. Maximum-Likelihood Decoding under Gaussian- 
distributed NBI 

As shown in Eig. [T] both approaches can be considered as a 
block coding scheme, where a linear binary {L, K) block code 
C is employed in the sense of chip-rate transmission with the 
coding rate given by 


Rc = 


K 

T 


Ti 


( 5 ) 


Hence, one can bound the error probability of this unified 
coding system in the presence of NBI under maximum- 
likelihood (ML) decoding to show the fundamental tradeoff 
of coding versus spreading. 


Eor ML decoding, one has to determine the codeword c 
for which the conditional probability density function p (r|c) 
reaches its maximum. 

In general, NBI is a stochastic process with infinite memory. 
In practice, it can be well approximated by finite memory. Eor 
ease of processing, a block-independent approximation is often 
employed, where the NBI process i can be partitioned into 
a sub-block vector form of i = iji • • • ) with each 
sub-vector ifc of length n = Tg/Tc □ satisfying E{ik ■ if} = 
Sk,iRi- Note that there is still some room for performance 
enhancement if one considers a longer memory size (> n) 
for NBI, which clearly compromises with increased decoding 
complexity. 

Then, p (r|c) can be factored as 

B 

p(r|c) = ]^p(rfc|cfc). (6) 

k=l 

To evaluate p{Yk\ck), it requires to know the probability 
distribution of ifc. Here, we assume that ifc is a Gaussianly- 
distributed vector, namely, ifc ~ A/^(0, Ri). If the NBI is 
generated by an AR process, this is just a precise assumption. 
If the NBI is modeled as a sinusoidal signal with multiple 
tones, or the digital NBI signal, this is approximately satisfied. 
With this assumption, (ISl) can be clearly represented as 

p (r|c) oc exp ^ (rfc - Cfc)^ Q~^ [vk - Cfc)^ , (7) 

where Pg is assumed to 1 and Q = Ri-\- a^I. 

Hence, an ML decoder only needs to choose a coded 
sequence c which maximizes the metric 

B 

r] = ^{ck,yk) + Kc)- ( 8 ) 

fc=l 


^It is assumed that the size of memory coincides well with the symbol 
period in the DS-SS approach for ease of processing. 
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where yk = Q and 

s 1 

Mc) = -'^^cIQ ^Cfc. (9) 

fc=i 


C. Error Probability under Multi-tone Interference with Or¬ 
thogonal Signatures 

The pair-wise error probability (PEP), which represents the 
probability of choosing the coded sequence c when the coded 
sequence c was transmitted, is the fundamental expression for 
the construction of the union or other upper bounds on the 
average error probability performance of a system. 

In general, it is difficult to derive the PEP in the presence 
of NBI. To gain essential insights, we, however, focus on a 
special class of NBI process, namely, multi-tone interference 
with orthogonal signatures 12 . This class of NBI process is 
approximately Gaussian-distributed when the number of tones 
is large thanks to the central limit theorem. Hence, the metric 
([ 8 ]l still holds with ML decoding. 

Letting rj (or p) denote the metric ([ 8 ]) for the correct (or 
incorrect) coded sequence c (or c), then the PEP of choosing 
the coded sequence c instead of the actual transmitted coded 
sequence c is given by 


P (c —>■ c) = Pr 


fj < 0 



( 10 ) 


The metric difference can be computed 


as 


JD 

= Yk) + A(c) - A(c), 


( 11 ) 




where 


1 

A(c) - A(c) = X! 




Eor analytic tractability, we should further introduce a series 
of approximations as did in the Appendix. Eor conciseness, the 
derivation is summarized in the Appendix. 

Let h = dn (c, c) be the Hamming distance between c and 
c, and 7 i, / = 1 , • • • , F, be the kh tone’s power-to-noise ratio. 
In the Appendix, it is shown that 


= F |?7 - p c| 


: 2cr 


-2 


and 


a, = D <fi - 


[v - »?|c| 


: 4(J 


-2 


-E 

1=0 


‘-E 

1=0 


li 


1 + nyi 


li 

1 + nyi 


(13) 


(14) 


for sufficiently large B. 

W 
have 


We now include the effect of Pg. Defining 7 ^ = we 


P (c c) Ri Q . 27 g [ 1 - 


li 


1=0 


1 + nyi 


(15) 


where Q{-) is the Gaussian integral function 


Q{x) = 


/*+oo 




exp ( ) dt. 


With simple union bounding technique lfT9l . the word error 
probability can be bounded as 


Pw < ^ AhQ 




A 


27. 1 - E 
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1 -b nyi 


(16) 


where Ah denotes the number of codewords of weight h in 
C. Note that the union bound on bit error probability can also 
be obtained by employing the input-output weight enumerator 

mu. 


D. Coding vs. Spreading 



Fig. 2. Comparison of minimum threshold of full coding vs. coded spreading 
for random codes as L —>■ cx). 


In this subsection, we still focus on the multi-tone inter¬ 
ference with orthogonal signatures, as it admits a closed- 
form expression for the upper bound on the pair-wise error 
probability (fTsT l. 

With BPSK modulation, it is clear that 7 s = RcEh/N^, 
where Ej, is the information bit energy and Nq/2 is the 
two-sided power spectral density of the white Gaussian noise 
process at the receiver. 

Define Ki = 1 - ^ = (lnA^)/P 

and 


co(Divsalar) 



(17) 


In mi, Divsalar derived a simple upper bound and further 
showed that, if E^/Nq > ^ cq(D ivsalar), the simple upper 
bound goes to 0 as the block size L goes to infinity. 

Eor the set of random linear {L, K) block codes of rate Rc, 
it is well known that 


fi{6)=H{S)-{l-Rc)ln2, (18) 

where H{S) = —Jin(5 — (1 — J) ln(l — J). 

Now, we are in a position to discuss the optimum coding¬ 
spreading tradeoff for NBI suppression. With a unified cod¬ 
ing view, a coded DS-SS approach can be viewed as a 
serially-concatenated coding approach, where direct-sequence 
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(of length n) spreading can be regarded as a simple (n, 1) 
inner repetition coding scheme. 

It is well known that the serial concatenation of any outer 
code with an inner repetition code can not produce any good 
code (namely, the weight distribution Ah,h > 0 is not 
desirable). For example, let us consider a powerful rate-1/2 
outer code with = H{6) — ^ In2, which is concatenated 

with an (n, 1) inner repetition code. Then, the concatenated 
code has /r(5) = ^^o{n5). By employing the simple bound 
im, the minimum Eb/No threshold conditioned on a given 
value of Ki can be computed as (L — oo) 


/ threshold 



co(Divsalar). 


(19) 


In the case of F = 1,7; = 20 dB, the minimum E^/Nq 
threshold versus the coding rate is plotted in Fig. |2] for 
both NBI suppression approaches. For the coded spreading 
approach, we have employed a rate-1/2 random code as 
the outer code, which is further concatenated with a (n, 1) 
repetition code (spreading). Therefore, an equivalent coding 
rate of ^ is obtained. For the full coding approach, the rate- 
^ random code is employed. As shown in Fig.|2l the optimum 
coding-spreading tradeoff always favors negligible spreading 
when L ^ oo. 

Therefore, we arrive at a conclusion that the entire band¬ 
width expansion should be dedicated to error control for NBI 
suppression and a low-rate full coding approach designed with 
the maximized coding gain could be better than the code-aided 
DS-SS approach!!. In the remainder of this paper, we show that 
this conclusion is also supported in practice through extensive 
simulations for three types of NBI. 


III. Low-Rate Full Turbo-Hadamard Codes 

For the purpose of NBI suppression, we employ a low-rate 
full turbo-Hadamard code for spreading the signal bandwidth. 
When such a codeword is transmitted over a channel with 
BPSK signalling, it can be viewed as the employment of 
coded spread-spectrum signalling with time-varying spreading 
sequences, which competes well with the traditional DS-SS 
signalling for NBI suppression. It should be mentioned that the 
original turbo-Hadmard codes proposed in ifThll use punctured 
Hadamard sequences for each codeword, which gives an 
obstacle for developing iterative decoding in the presence of 
NBI. Without puncturing, it also benefits a potential signal 
acquisition mechanism for the proposed full coding approach 
(with time-varying spreading sequences). 


A. Hadamard Codes 


An n X n Hadamard matrix with n = 2’' can be recursively 
constructed as 


Hn 

and Hi = [+1]. 


+Hn/2 +Hn/2 

+Hn/2 —Hn/2 


( 20 ) 


^In essence, this section provides just a partial justification of this claim due 
to a series of approximations and the restriction on multi-tone interference. 
Hence, a rigourous proof is still missing. 


A length-2’' bi-orthogonal Hadamard code carries r 1 
information bits. Therefore, the rate of a length-2’' Hadamard 
code is Rh = For such a code, the codeword set is 

formed by the columns of EHn, denoted by {±h^, j = 
0,1, • • • , 2’' — 1}. In a systematic encoding, the bit indexes 
I = {0,1,2,4, ••• ,2’’“^} are used as information bit posi¬ 
tions. 

B. Convolutional-Hadamard Codes 

To encode a convolutional-Hadamard code, the information 
bit stream is first segmented into blocks of r bits. The fcth 
block can be written as 

dfc = \dkr^dkr+l^‘ ‘ ‘ idkr+r—\\ (21) 

where dkr+j S {0,1}, j = 0,1, • • • , r — 1. Then, each block 
is employed to produce a parity-check bit. For the fcth block, 
the produced parity-check bit is 

Pk — dkr © dkr+1 © * * * 0 dkr+r-l- (22) 

The parity bits of information blocks {pk} are further input 
to a rate-1 recursive convolutional code to produce the coded 
bits {qk}. The simplest rate-1 recursive convolutional code 
is a two-state convolutional code with generator 1/(1 -b D), 
namely, the binary accumulator or the differential encoder, 
where the fcth output coded bit is 

qk=qk-i®Pk- (23) 

The information blocks {dfc} are then appended with {qk} 
to form the augmented input blocks [d^, qkY' ■ The augmented 
blocks, each with r + 1 bits, are input to the encoder of a 
Hadamard code, producing n = 2’ coded bits for each block. 


C. Full Turbo-Hadamard Codes 

A full turbo-Hadamard code is constructed by con¬ 
catenating several convolutional-Hadamard codes in paral¬ 
lel. Let D = [do,di,--- ,di,_i] be a group of infor¬ 

mation bits, which are input to the encoder for produc¬ 
ing a full turbo-Hadamard codeword. As shown in Fig. 
12 D (= and its interleaved versions = 

1, • • • , M — 1 are employed by the component convolu¬ 
tional Hadamard codes to produce M Hadamard codewords 
^ — [CmL; ‘ ; ^rriL-kL—l]-! nr — 0, * * * , AF 1 

of size 2’ X L. Hence, a full turbo-Hadamard codeword can 
be obtained by collecting all component codewords, namely, 
C = = [co,Ci,--- ,cml-i], where 

Ck, fc = 0,1, • • • , ML — 1, is the column vector of length 2’’. 

Compared to the original turbo-Hadamard codeword 1161 , a 
full turbo-Hadamard codeword consists of M sub-codewords, 
produced by M component convolutional-Hadamard codes 
without puncturing. Hence, information bits can be repeatedly 
observed in the final codeword. The employment of full com¬ 
ponent Hadamard codewords can facilitate NBI suppression 
without sacrificing much bandwidth since the rate of each 
convolutional-Hadamard code is very low. With a full turbo- 
Hadamard code using BPSK modulation, the transmitted sig¬ 
nal can be seen as a kind of direct-sequence spread-spectrum 
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Fig. 3. System Model. 


signalling with time-varying spreading-sequences (Hadamard 
sequences) of fixed length n = 2’'. 

The rate of a full turbo-Hadamard code is simply given by 

~ M2’'’ 

while the original turbo-Hadamard code is of rate 

^ r + M{2^-r)' 

Hence, the ratio is 

Rf _ M2’' - (M - l)r 
Rth ~ ’ 

which quickly approaches 1 as r increases. 

I'V. Iterative Decoding in the Presence of both 
NBI AND AWGN 

We have shown in Section-II the potential of a full coding 
approach in NBI suppression with ML decoding. However, the 
complexity issue makes an ML decoder impractical. In this 
section, we develop a practical iterative decoding algorithm 
in the presence of both NBI and AWGN for a low-rate full 
turbo-Hadamard coding approach. 


(24) 

(25) 

(26) 


A. Channel Model 

With a vector representation of the channel model @, we 
assume that the NBI is a block-independent random process. 
For convenience, it is always assumed that the block memory 
length of NBI is the same as the length of component 
Hadamard codeword (n = 2’). 

Therefore, when a full turbo-Hadamard codeword C = 
[cqjCi,--- ,cml-i] is transmitted, the received equivalent 
complex base-band signal vector in the duration of Hadamard 
codeword nTc can be represented as where is now 
the fcth (component) Hadamard codeword of a full turbo- 
Hadamard codeword. 

In what follows, three types of NBI signals ||2l, multi- 
tone signal, autoregressive (AR) signal, and digital signal, 
are considered. For conciseness, we still use = 1 in this 
section. 


B. APP Decoding of Hadamard Code in the Presence of NBI 
Assume now that all of the Hadamard codewords have 
independent and equal probabilities of occurrence. Let = 
[cfc[0], Cfe[l], • • • , Cfc[n — 1]]^ be the transmitted fcth Hadamard 
codeword and be the noisy observation of Cfc dill. The 
APP decoding of a Hadamard code over 1} involves 

evaluating the logarithm-likelihood ratio (LLR) 


Lk[i] = log 


Pr{ck[i] = +l|rfc) 
Pr{ck[i] = -l|rfc) 


Yu P(ffc|cfc) 

, Cfc[i]=-|-1 

E Ptaic)’ 

Cfc[i] = -1 

z = 0,l,--- ,2’'-!. (27) 


Let us define 

i/;(±h't) = exp(±(h't,yfe)), 

= exp (± (hfyk) +Xj) , (28) 


where 

A, = (29) 

Then, dZTl ) can be expanded as shown in the top of the next 
page. 

In the absence of NBI, it can be shown that A, = — 
since cr^h-^ Efficient techniques for 

evaluating (l28l l and (l30l) were proposed in ifTbll using FHT 

In the presence of NBI, we now show that the FHT-based 
efficient techniques still work with the assumption that the 
NBI process is stationary. 

For a stationary NBI process, the covariance matrix Q does 
not change for a sufficiently long period. Hence, Xj,j = 
0,1, • • • ,2’' — 1 ( |29] ) can be pre-computed and the received 
signal vectors {r^} are properly modified to obtain {yfc = 
Q~^rk}. 

The inner products (hfyk),j = 0,1, • • • , 2’' — 1 are 
elements of Hnyk and thus can be efficiently evaluated by an 
FHT of size n = 2’. The results are then modified using the 
pre-computed \j and 2n exponential functions are performed 
for obtaining '0(±h'^), j = 0,1, • • • , 2’' — 1. 

By defining two 2’’ x 1 sized compound vectors a and b 
with 


a\j] 


fi+y) 


J = 0,1,- 


, 2 ’’-! 


(31) 
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Lk[i\ = log 


X! exp (rfc - h'^)^Q ^ (rfc - h-^)^ + ^ exp (rfc + h-^)^ Q ^(rfc + h^)^ 


H[i,j\=+1 


H[i,i\ = -1 


= log 


^ exp f--(rfc - h-^) Q ^ (rfc - h^) 

^ V'Cih^) 

-tr[i,i]=±i 


Z! exp 
H[i,3\ = + l 


-i (rfc + h-^)^(5 ^ (rfc +h^) 


Z V'Cih^) 


(30) 


and 

m = 




E 


it can be again shown IfT^ that 


'0(±h'l) 


,t = 0,l,--- ,2’'-!, (32) 


where Qn is a n x n matrix obtained from i/„ by the following 
replacements; 


+ 1 ^ 


1 0 
0 1 


) ~1 


0 1 
1 0 


(34) 


The derivation process is the same as that of m, and thus 
omitted here. 

As shown in m, the computation of (l33T l can be efficiently 
carried out using an n-point APP-FHT. 


C. Soft-In/Soft-Out Decoding of Convolutional-Hadamard 
Codes 

For soft-in soft-out (SISO) decoding of convolutional- 
Hadamard codes, the Bahl, Cocke, Jelinek, and Raviv (BCJR) 
algorithm can be employed. It is based on the trellis de¬ 
scription of convolutional-Hadamard codes as shown in ifTbll . 
A simple 1/(1 -t- D) convolutional code has 2 states and 
2'’ branches per state. Therefore, there are 2’’ parallel edges 
connecting Sk (state at the fcth block-wise time epoch) to Sfc+i 
and the branch metric function can be computed as 

7fe(sfc,Sfc+i)= ^ f{ck), (35) 

cfceC(sfc,sfc+i) 

where C(sfc, s^+i) is the set of possible Hadamard codewords 
connecting Sk to Sfc+i. 

The BCJR algorithm can be characterized by the following 
forward and backward recursions: 

0;fc-t-l ('^fc+l ) — ^ ^k+l) t (36) 

Sk 

Pkisk) = Z Pk+i{sk+i)lk{akjSk+i). (37) 

Sfc + l 

Finally, the log-likelihood ratio at the ith bit-wise time epoch 
for the fcth Hadamard codeword is computed as 

Z 'f{ck)ak{sk)l3k+i{.Sk+i) 

Lk{i)= log -. (38) 

> , ^/(cfe)afc(sfe)/3/c+i(sfc+i) 

Cfc[i] = -1 


For iterative decoding, it is essential to compute the extrinsic 
information for systematic information bits. For an AWGN 
channel, the extrinsic information in the log-likelihood form 
at the positions of information bits can be computed as 

Ll{f) = Lk{i) - LUi) - L, • rk{i), i e I, (39) 
where Lc = 2-^^5-- 

In the presence of NBI, the last term in (l39]) cannot be 
directly employed as it was ruined by NBI. Hence, we need 
to estimate this term, which, however, is not easy in general 
in the presence of NBI. Here, we propose an approximation 
by simply omitting this term, giving 

Ll{i)^Lk{t)-Ll{i),zeI, (40) 

for the extrinsic information at the positions of information 
bits. Indeed, due to very low-rate coding, we have \X\ <C L, 
and the contribution of Lc • rk{i) is also very limited. Hence, 
this approximation is justified. Simulations show that this 
approximation method does work well. 

D. The Overall Decoder 

With the SISO decoder for each component convolutional- 
Hadamard code, the overall decoder structure is the same as 
that of Fig. 7 in ifTbl . and thus omitted here. 

V. Extension to Multipath Fading Channels 

In practical wireless communication systems, an AWGN 
channel model may not be applicable. Instead, multipath 
fading channels are often considered. 

In general, the multipath scenario suffers several difficulties. 
Firstly, low-rate turbo-Hadamard codes perform well in an 
AWGN channel, which, however, may perform badly for 
some multipath channels (or inter-symbol interference (ISI) 
channels). Secondly, with the introduction of fading, practi¬ 
cal wireless communications essentially see an ensemble of 
multipath (or ISI) channels, which constitutes a main obstacle 
for code design. Indeed, design of “good” codes for multipath 
fading channels is still a big challenge. 

In this section, we do not discuss the code design problem. 
Instead, we focus on the decoding of low-rate turbo Hadamard 
codes in the presence of both NBI and multipath fading. Quasi¬ 
static fading is considered, where the multipath taps remain 
fixed during the block of a codeword, but independently 












varying from one block to another. We assume that the receiver 
input is preceded by a matched filter, and then followed 
by a noise whitening filter. Hence, a discrete-time complex 
baseband representation of the multi-path channel with P +1 
non-zero taps is considered, where the delay of tap I is denoted 
as Ti, and the coefficient of tap I is fi- The channel output in 
its complex form can be written as 

p 

Tk = foCk + ^ fvCk-n -\-ik-\- Wk, (41) 

where {ik} is a complex NBI sequence, and {wk} is a complex 
AWGN sequence. 

Suppose the length of Hadamard sequence is large enough 
so that maxjri,-- - ,rp} < n. By collecting n received 
samples (HTt (similar to Q), the received signal in a vector 
form of length n can be written as 

p 

ffc = /oCfc-f +ife+Wfe, (42) 

1=1 

where Ck-n = denotes shifting down 

(H-) or up (-) by t; positions and the vacant positions are filled 
with zeros. 

For simplicity, it is assumed that both {/;} and {r/} are 
perfectly estimated and available at the receiver. Given {/;} 
and {t/}, we denote the ISI part in (l42l i as 

L 

Cfe_i =ip{ck,Ck-i) = foCk + '^fiCk-n, (43) 

1=1 

which is a function of both and Ck-i- 

In the presence of both NBI and AWGN, one can show that 

logp(ffe|cfc,Cfc_i) oc - (ffc - Q~^ (ffc - Cfc_i) (44) 

where Q = i?[ifcij,]-|-£'[wfcw[.] with (•)! denoting the complex 
conjugate of the transpose. 

The SISO decoding of component convolutional Hadamard 
codes can now be again implemented using BCJR algorithm, 
but with expanded super-state trellis. The super state at time 
epoch k is formed by joining the state pair of the component 
convolutional Hadamard code at time epoches of k and k — 1, 
namely, = {sk-i,Sk)- With max{ri,--- ,tl} < n, the 
multi-path fading essentially introduces the symbol memory 
of 2 with symbol denoting the vector of Hadamard sequence. 
Let S denote the number of states for each component convo¬ 
lutional Hadamard code. Then, the number of super-states is 
2S. Therefore, the decoding complexity is almost independent 
of P thanks to the use of long Hadamard sequences. 

With SISO decoding of component convolutional Hadamard 
codes, iterative decoding of turbo Hadamard codes in the pres¬ 
ence of both NBI and multipath fading can be implemented 
in a similar manner as discussed in Section-IV. 

VI. Simulation Results 

In this section, the proposed turbo-Hadamard coding ap¬ 
proach is compared with the code-aided DS-SS approach with 
convolutional coding. We employ the traditional convolutional 


code instead of the powerful turbo code for the code-aided 
DS-SS approach, due to the use of short block length for fast 
simulations. In our simulation, the information bit length of 
200 is employed for the convolutional code of constraint length 
7, and Viterbi decoding is employed for the NBI suppressed 
MMSE (soft) outputs k = 1, • • • ,F (please refer to (|4|i). 
With this short information bit length, we notice that turbo 
codes cannot show much advantage over the convolutional 
code of constraint length 7 in performance. 

In the past years, various NBI suppression methods were 
widely employed such as in the literature 0, a-Q, ii- 
ini. Although various NBI suppression techniques may result 
in different performance, we do not compare these techniques 
with our work, since much of these works focus on the signal 
processing techniques. By employing the upper bounds for 
evaluating the ML performance as in Section-II, the traditional 
DS-SS approach shows its performance weakness compared to 
a full coding approach for NBI suppression, no matter what¬ 
ever signal processing technique is employed. This theoretical 
performance weakness is mainly caused by its spreading 
(repetition coding) structure, which leaves limited room for 
performance improvement with advanced signal processing 
techniques. 

For a full turbo-Hadamard code, we use N for the in¬ 
terleaver length, M for the number of component codes, R 
for the code rate, r for the order of the included Hadamard 
code, g{D) for the generator polynomial of the employed 
convolutional code and k for the iteration number. Unless 
specified otherwise, k, is set to 10. 

For ease of comparison, it is supposed that the chip rates 
observed over the channel for both approaches are just the 
same. For the code-aided DS-SS approach, the spreading 
sequence is a Hadamard sequence with length 32 and the rate- 
1/2 convolutional code with generators Gi = 171, G 2 = 131 
is employed. For the turbo-Hadamard coding approach, the pa¬ 
rameters are set as follows: M = 2, r = 5 and g{D) = 
Hence, the Hadamard sequences are of the same length 32 for 
both approaches. 

For fast simulations, N = 200 is assumed unless specified 
otherwise. With various parameters described as above, the 
rate of the full turbo-Hadamard code is Rp = = ^. If 

information bits are input at a rate of /{, bits/s, the resulting 
transmission chip rate observed over the channel should be 
equal to fc = fb/R = fbM2^/r. For the rate-1/2 convo¬ 
lutional coded DS-SS system, the transmission chip rate is 
equal to fc = 2/f,2’'. For APP decoding of Hadamard codes 
in the presence of NBI, the covariance matrix Q is required. 
In simulations, Q = E {^Vkr^} is pre-computed during the 
training mode. 

With an equal channel bandwidth allocated for both ap¬ 
proaches, it is clear that the information transmission rate for 
the turbo-Hadamard coding approach can be r = 5 times 
higher than that of the traditional DS-SS approach with rate- 
1/2 convolutional coding. In what follows, we show that 
with such a significantly-higher transmission rate, the turbo- 
Hadamard coding approach can still perform better than the 
traditional code-aided DS-SS approach. 
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A. Tone Interference 

For tone interference, its complex version takes the form of 

= (45) 

1=1 

where F is the number of tones. Pi and fi are the power 
and normalized frequency of the Zth sinusoid, and {fi} are 
independent random phases uniformly distributed over [0, 2tt). 
For the real channel model employed in Q, it simply takes 
the real part of ik, namely, ifc = 5? {ik)- 



Fig. 4. Comparison of the BER performance for the two approaches with 
multi-tone interference (orthogonal signatures). 

In II 20 I . we have shown the performance of the proposed 
turbo Hadmard approach under the general multi-tone inter¬ 
ference with randomly-generated frequencies. Here, we focus 
on the multi-tone interference with orthogonal signatures. 
Simulation conditions are set as follows: F = 3, the interfering 
tones have the same power, and the total interference power 
is kept constant at 25 dB relative to a unity power signal 
Ps = 1. To ensure orthogonal signatures, fi — fk is chosen as 
the multiple of 1/n = 2“’’ for all I k, and fi is randomly 
picked from [0, 27r). All of conditions remain the same for 
both approaches. 

Simulations have been carried out to show the capability 
of both approaches against the multi-tone interference with 
orthogonal signatures. It is shown in Fig. |4]that the proposed 
turbo-Hadamard coding approach still outperforms the tradi¬ 
tional code-aided DS-SS approach although its transmission 
rate is about 5 times higher than the code-aided DS-SS 
approach. In Fig. H] we also plotted the decoding performance 
for turbo Hadamard codes with perfect knowledge of NBI, as 
a benchmark. As shown, the proposed turbo-Hadmard coding 
approach performs very close to the decoding counterpart with 
perfect knowledge of NBI, and about 0.2 dB in SNR loss is 
observed. 

For multi-tone interference with orthogonal signatures, the 
union upper bound on the bit error probability similar to (fTbl l is 
also shown in Fig. 4. By referring to (fTbl l. the loss in Eij/Nq 
is about 0.4 dB due to multi-tone interference. Clearly, the 


multi-tone interference with orthogonal signatures are much 
less harmful than the general multitione interference. 

B. Autoregressive (AR) Interference 

Suppose now that the NBI signal can be modeled as a p-th 
order AR process, where p ^ N, i.e., 

p 

ik = - ajik-j + efe, (46) 

where Ck is a white Gaussian process with variance e^. 



Fig. 5. Comparison of the BER performance for the two approaches with 
AR interference. 

In our simulation, the NBI is generated by a second-order 
AR model with both poles at 0.99, i.e., ai = —1.98 and 02 = 
0.98. The total interference power is kept constant at 25 dB 
relative to a unity power signal {Pg = 1). 

It is shown in Fig. |5] that the proposed turbo-Hadamard 
coding approach outperforms the traditional code-aided DS- 
SS approach although its transmission rate is about 5 times 
higher than the code-aided DS-SS approach. 

C. Digital Interference 

An NBI signal can also be a digital communication signal 
with a data rate much lower than the spread-spectrum chip 
rate. The digital NBI model can find its applications when the 
spread-spectrum communication system works concurrently 
with some narrow-band digital communication systems. Here, 
we assume a fixed relationship between the data rates of the 
two users, i.e., q bits of the narrow-band user occur for each 
bit of the SS user. 

In general, the digital NBI signal and the SS signal are 
asynchronous. Let to be the fixed time lag between the SS bit 
and the nearest previous start of an NBI bit. 

The digital NBI is generated by a base-band digital BPSK 
signalling with rate fi = ^ and a fixed lag tg = IST),. The 
total interference power is kept constant at 20 dB relative to 
a unity power signal (Pg = 1). 
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Fig. 6 . Comparison of the BER performance for the two approaches with pjg 7 ggR performance of the turbo-Hadamard coding approach for 

digital interference. different values of M and N with AR interference. 


Assuming that the digital NBI signal has a waveform of 
rectangular pulse, the autocorrelation function of the chip- 
sampled NBI signal is then 


R,{k) 


0, |A:|>L 


(47) 


Although the digital NBI is far from Gaussianly-distributed, 
the proposed algorithm does work and even outperforms the 
traditional code-aided DS-SS approach as shown in Fig. |6] 


D. Impacts of M, N and r 

The performance of turbo-Hadamard coding approach can 
be enhanced if either the interleave length N or the number of 
component codes M increases. This is well explained in Fig. 
|7] for the AR interference with the same setting as before. It 
should be noted that the increase of M can reduce the spectral 
efficiency. As shown, the turbo-Hadamard coding approach 
performs excellent with M = 3 and N = 1000 for strong AR 
interferences. 

With the increase of r, the length of spreading sequence 
is exponentially expanded (n = 2’’), resulting into improved 
processing gain. However, the BER performance of the code- 
aided DS-SS approach with convolutional coding cannot be 
improved as shown in Fig. 0 The reason is that the capability 
of NBI suppression can be achieved with relatively short 
spreading sequence and its BER performance is largely deter¬ 
mined by the employed convolutional coding scheme, which 
remains almost fixed with the increase of r. With the proposed 
turbo-Hadamard coding approach, the BER performance can 
be steadily improved with the increase of which means that 
a significant coding gain can be obtained with a lower coding 
rate. 


E. Multipath Fading Channels 

To gain an essential insight into the performance of the 
proposed full coding approach under multipath fading chan¬ 
nels, a simple two-tap channel model with ti = n is em¬ 
ployed. Hence, this ISI channel model can be characterized 



Fig. 8 . The BER performance of the two approaches for different values of 
r with AR interference. 



Fig. 9. The BER performance of turbo-Hadamard coding approach in 
both NBI and multipath (fading) channels, where ISI-Chl: [/o,/i] = 

[^ 374 , 7174 ]; ISI-Ch2:[/o,/i] = [ 7172 ,^ 172 ]; ISI-Ch3:[/o,/i] = 
[x/V4, v/374]. 
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TABLE I: Decoding Complexity Per Information Bit 


Approach 

Mul./Div. 

Exp./Log. 

Add./Comp. 

Proposed turbo-Hadamard 

340 

276 

824 

Code-aided DS-SS 

2 

0 

192 


2, tt = 10). The proposed turbo-Hadmard coding approach has 
significantly higher complexity, which is mainly due to the full 
coding approach and the employment of iterative decoding. 


by [/o,/i] if no fading is considered. We consider three ISI 
channel models, namely, ISTChl: [/o,/i] = [\/3/4, y^l/d], 
ISI-Ch2:[/o,/i] = [7172, V^], and ISI-Ch3:[/o,/i] = 
a/3/4], respectively. 

The complex AR interference is assumed, and its real (or 
imaginary) part takes the same setting as before. As shown in 
Fig. |9] the decoding performance under ISI channels perform 
worse than that under the AWGN channel, and deteriorates 
when the second tap fi becomes more dominant. 

With quasi-static fading, we consider that both /q and fi 
are independently generated according to complex Gaussian 
distribution with zero mean and variance of / Also shown 
in Fig. |9] there is an obvious error floor for multipath fading 
channel. The error floor comes from some bad realizations 
of multipath fading channel, namely, max{ | /i |, | /o |} 1 or 

I/ll » l/o|. 

F. Complexity Issue 

In this subsection, we summarize the computational com¬ 
plexity of the proposed turbo-Hadamard coding approach in 
the AWGN channel, which is compared with that of the code- 
aided DS-SS approach with convolutional coding. For ease of 
comparison, we assume that the length of spreading sequence 
is of size 2’’, as adopted in our simulation. 

With the introduction of NBI, both approaches require to 
modify the received signal vectors as yk = where 

Q~^ can be efficiently updated using the recursive least- 
squares (RLS) adaptive algorithms. Compared to the code- 
aided DS-SS approach, the proposed approach requires to 
further pre-compute Xj,j = 0, • • • , 2’' — I (l29l l. As the cost 
in this pre-computation stage is almost the same, we do not 
consider it for final comparison. 

The decoding complexity of the proposed turbo-Hadamard 
coding approach can be summarized as follows. With itera¬ 
tive decoding, the decoding complexity is determined by the 
number of iterations k and the operations required for M 
component APP decoders in each decoding iteration. Each 
convolutional-Hadmard APP decoder is implemented section- 
by-section over S'-state trellis and it was estimated in M 
that for each section, about 10 x 2’’ — 2r -f 45 — 12 addi¬ 
tions, 2 X 2’’ -I- 4 -I- 85 multiplications/divisions, 2 x 2’’ -f r 
exponential/logrithm functions are required. 

The decoding complexity of the code-aided DS-SS approach 
with convolutional coding is evident El. Whenever the refined 
signal vector is computed, the linear MMSE detector can 
be directly implemented by vector multiplications. With rate- 
1/2 convolutional coding, it requires 2 multiplications per 
information bit. The decoding complexity of convolutional 
code is well known, which is determined by the constraint 
length (Viterbi algorithm). 

The decoding complexities per information bit are summa¬ 
rized in Table. I for both approaches (r = 5,M = 2,5 = 


VII. Conclusion and Euture Work 

In this paper, we have derived upper bounds on the error 
performance of coded systems in the presence of both AWGN 
and multi-tone interference with orthogonal signatures, which 
can be employed to evaluate the system performance. By using 
tight bounding techniques, we have provided a partial justifi¬ 
cation that the optimum coding-spreading favors full coding 
for the purpose of NBI suppression. It should be emphasized 
that a rigourous proof of this justification is difficult due to 
mathematical intractability for general classes of NBI. 

More practically, we have proposed a low-rate full turbo- 
Hadamard coding approach for NBI suppression. With proper 
iterative processing, it was shown that the proposed low-rate 
coding approach performs better than the traditional coded DS- 
SS approach for general classes of NBI with noticeably higher 
spectral efficiency. Eor iterative decoding Hadamard codes in 
the presence of NBI, we found that the fast EHT-based APP 
algorithm can still work, which makes this approach attractive 
in practice. The proposed full coding approach can also be 
adapted to multipath fading channels, and a low-complexity 
iterative receiver exists if the length of underlying Hadamard 
sequences is not smaller than the multipath time. 

With a full turbo-Hadamard coding approach, the employ¬ 
ment of DS-SS signalling with time-varying spreading se¬ 
quences can be assumed, which could be potentially employed 
for signal acquisition. Indeed, there are only n = 2’’ spreading 
sequences for an n x n Hadamard matrix with n = 2^, while 
the space of binary spreading sequences of length n is of 
size 2". Therefore, the receiver may search n = 2’’ spreading 
sequences in parallel for the acquisition of the incoming full 
turbo-Hadmard coded signal, where EHT could be efficiently 
employed to make this search process faster. As this topic 
is rather involved, much work remains open. Indeed, we can 
expect a prospect application of full coding approach in future 
military communications if the acquisition of low-rate full 
coding signal can be efficiently implemented. 

Einally, the multiuser scenario deserves investigation in the 
future. 
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Appendix 

Evaluation of the PEP 

In this appendix, we consider a special class of NBI process 
with F tones fi,l = I,2,--- ,F, as defined by (l43t . Eor 
ease of derivation, we further assume orthogonal signatures, 
namely, 

sfSk=n5i^k,yi,k€[l,F] (A.l) 

where gi = [I, ‘ ‘ i 
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It has been shown in ||2l that 

= _2 o sisf 


1=0 


0-2 + nPi 


(A.2) 


Then, we have 




7i IT 12 
Cfcgi 




k=l \ 1=0 

F 


1 + 717; 


2a2 


1 ^ 

li _ j_y^ 

1 + 777; i? 
i=0 ' k=l 


Cfe & 




1 + n'ji 

1 -E 


i=0 

F 


1=0 


l + nji I ' 


(A3) 


where 7; = Pija^, E{-'\ is taken with respect to Cfc and the 
last step is due to 


^{|cfegi|^} = \i{E {cl Ck}gmf) 


(A.4) 


In the above derviation, we have used the approximation 
that |cfegi|^ ~ £;||c|’g;|^| for large B and the 

ergodicity of the sub-vector over the column space of Pin- 
Hence, 

A(c) - A(c) « 0, (A.5) 


and the metric difference can be simplified as 

B 

V-fl^'^{ck-Ck,yk)- (A.6) 

k=l 


Next, we proceed to derive both the mean and the variance 
of Tj — fj assuming that the codeword c is transmitted. It is 
straightforward to show 

B 

c| = ^ (cfc - Cfc)^ Q~^Ck. (A.7) 

k^l 

Without loss of generality, we assume that Ck differs from 
Cfc at hk head positions. Hence, we employ a sub-vector 
decomposition of both Cfc and Cfc, namely, Cfc = 
and Cfc = Thus, Cfc - Cfc = [2u^^, 

It follows that 


= E- 


77-77 


(cfc - Cfc)^ Q ^Cfc = 2 ct ^ hk - ^ 




1=0 


1 -I- 777; 


^k,l , (A.8) 


where ^k,i = + K.SiMS^n-h^^n-h^ and g; = 

r T T IT 
Lo/./ifc ’ &Z,n—/ifc-l 


Thus, 


7i 


= 2a "E 

/f-1 \ 1^0 

= 2a-^(h-y^^ 

V t^i + ”T''fc=i 

/ F B 


ik,l 


1 -f 777 ; 

B 

y^k,i 


2a-M/7-E 


> 


(A.9) 


where h = X]fcf=i denotes the Hamming distance between 
c and c. 

Due to the summation of ^k,i over blocks (k), we can use 
E{£,k,i} in place of ^k,i, where E{-} is the expectation with 
respect to Cfc for a given hk, leading to 


E{^k,i} = E{\ul^giy } 

+E{ul^gl^hJ ■ Eig^kj^Vn-h^,} 

= hk. (A. 10) 


Hence, we get 


l—O l+n7i 

For computing the variance, we note that 

B 


h. 


(A.ll) 


E{{j)-y c} = ^T;||(cfc. - Cfc.,yfc)|^ Cfc I 

k^l 

B 

=^(cfc - Ck)'^Q~^ [ckcl + Q] Q~^{ck - Ck) 

k^l 

B 

=E’^ |?7 - 7 ? c| + ^(Cfc - Ck)'^Q~^{ck - Cfc). 


k^l 


Then, we get 

D |?7 — 77 c| = i? |(p — 77)^ c| — E^ ^fj — ?7|c| 


A 

^ — 


B 


— ^ ^ (cfc Cfc) Q (cfc Cfc) 


4a-^ 


i-E 


ll 


1 + 777 ; 


h. 


1=0 
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